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ABSTRACT 

The  representation  for  quantiles  discussed  by  Bahadur  (1966)  and 
Ghosh  (1971)  is  extended  to  quantiles  from  the  residuals  in  a linear 
model.  As  an  application,  a robust  test  for  symmetry  is  proposed. 
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I.  Introduction 


Let  independent  and  identically  distributed  with 


common  distribution  F,  and  let  F(C)  = p.  Let  be  a sequence 


of  integers  = np  ♦ o (n^^^  log  n) , and  let  be  the 


sample  quantile.  Bahadur  (196(>)  and  Ghosh  (1971)  have  shown  that  if 


F^  is  the  empirical  distribution  function  of 


(1)  (V^-e-(k^/n  - Fjj(0)/F'(0)  ^ 0. 


Actually,  Bahadur's  result  is  an  almost  sure  result,  but  (1)  suffices 


for  many  statistical  applications.  Our  goal  is  to  extend  (1)  to 


the  quantiles  of  the  residuals  in  a simple  linear  model,  using  this 


to  conduct  a quick  test  for  symmetry. 


We  consider  the  simple  linear  model  ^ * ^i 


where  y, ,...,y  are  i.i.d.  with  distribution  F continuous  and 
'I  "^n 


strictly  increasing  in  a neighborhood  of  C,  with  F(C)  = p. 


If  B is  an  estimate  of  B (possibly  the  least  squares  estimate 


or  one  of  the  new  robust  estimates),  the  residuals  are 


r.  » z.  - xT  B = y.  -xf  (B  - B).  Let  E (F  ) be  the  empirical 
in  1 — 1 -n  •'i  — 1 '-n  — n n 


distribution  function  of  the  residuals  (errors),  and  choose 


-1/2  2 

= n log  n , b * (log  n)  . Let  k be  as  above,  let 


I » (£-a  ,C+a  ),  and  define  V to  be  the  k order  statistic 
n n n'"  n n 


of  the  residuals.  We  make  the  following  assumptions: 


:SSI0N  for 


(Al)  F has  two  bounded  derivatives  in  a neighborhood  of  ’ 


C , and  F'(e)  - f(C)  > 0. 


,£  i Whlti  Sictta  B 

Buff  smum  a 
UNAWtOUNCa)  □ 

JUSTIFICATION  ■ - 


(A2)  a„'"  (^-B  ) 0 (a.s.) 

n — n — 


MMO/lMlnnT  coro 

Dist.  M . lC  andy- or  special' 


1/2 

(A3)  For  some  6 > 0,  aj^'  " max{  | | : i»l , . . . ,n}  0 . 

(A4)  There  exists  Xq  finite  with  (log  n)n*^  (x^  - j^)  -►  0 . 


Theorem  Under  conditions  (Al)  - (A4), 

(2)  n^''2|(V^  - C)  - (k^/n  - F^(C))/f  (O  + x^  (^  - B)  | -^  0 (a.s.) 


Remarks  Condition  (Al)  is  the  same  as  Bahadur's,  while  (A2)  is 

quite  reasonable.  Condition  (A3)  guarantees  that  the  design  elements 

will  not  vary  too  wildly.  The  usual  condition  on  the  design  matrix 

X is  that  n ^X'X  -►  I (Drygas  (1976)),  and  this  implies  that  if 

there  is  an  intercept  term  there  is  an  3^  with  n"^^"  (x^j^  - 3^)  -►  0, 

so  that  (A4)  is  only  a slight  strengthening  of  a standard  condition, 

which  in  fact  is  reduced  to  n’^T"  (x.  - x ) -►  0 at  the  end  of 

‘•1  —1  -o 

Section  2.  Note  that  (A3)  and  (A4)  are  guaranteed  in  the  problem 
considered  by  Bahadur  and  Ghosh. 

2.  Proof  of  the  Theorem 


We  first  consider  simple  linear  regression  without  an  intercept 
■ XjB  ♦ yj^.  The  problems  of  simple  and  multiple  linear  regression 
with  an  intercept  are  easy  consequences  of  the  proof  presented  here. 
Define  the  following  processes: 

G„(x)  - n’*  I {I(r.  s x)-I(y.  s c)  - (F(x+x.(B  -B))-F(x))} 
n 1*1  ^ ^ ^ n 

H ■ supilG  (x)l:  X c I } 


W^(s,)  - n 


-1/2 


I 

i-1 


ICXj  ^ C ♦ a^s+a^tXj)-F s t) 


-F(C+aj^s+a^tXj)+F(e) 


3 


where  1(A)  is  the  indicator  of  the  event  A.  We  note  that  from 
(Al)  - (A4), 

(3)  n'^  I {F(C*sa  )-F(e+sa  ♦ta  xj+ta  X f(5)}  * 0(n"'^^) 

n n n X no 

uniformly  for  Os|s|,|t|s  1 

Lemma  1 Under  (Al)  - (A4) , -►  0(a.s.) 

Proof  of  Lemma  1 Since  r^^  " Xi  ' by  (A2)  is  suffices 

to  show  that  sup  {|W^(s,t)|  : o s s,t,  s 1}  o (a.s,)  . 

For  this,  we  may  consider  only  x^^  i o by  breaking  the  sum  defining 
W^  into  two  parts,  one  with  i o and  the  other  over  the  terms 

x^  < o.  By  (Al)  as  in  Bahadur ‘s  proof,  it  also  suffices  to  consider 

points  s,t  r/b  (r  = o,...,b  ).  To  see  this,  note  that  if 

r,n  n n 

l*-\,nl  ^ *’n'  l^■^,nl  ^ ‘’n’ 

p.n\  *i^>l 

* ^f*n*’n'^^  “ 0(n‘^'^^). 

Now,  by  Bernstein's  inequality  (Hoeffding,  eq.  2.13)), 

for  some  constants  Cq»?  depending  on  e.  Thus, 


j 


4 


PptlWnCs.t)  |>e  for  some  n^n^,  (s,t)  = Cnj.jj.npj^) } 

^ 2 1/4 

5 y c b ^exp{-c,n^' -*•  o as  n -*■  * . 

n=no 

This  completes  the  proof  of  the  Lemma.  □ 

Lemma  2 Almost  surely  as  n V el 

Proof  of  Lenmia  2 We  have 

n 

Pr{V^i  5 ♦ » Pr{  I I(yj<  C ♦ a^^+x^Cej^-e))  ^ k^}  . 

It  suffices  to  show  the  existence  of  an  n > 0 for  which 

0^  (n)  0,  where 

° n 

0 (n)  ■ Pr{  y.  I(y^  s 5+a^+ta^x^)  s k^  for  some  OstSn  , n^n^} 

-1  ” 

* ***‘^*’n^^**n^  ^ k /n+n"  ^ (F(C+a  )-F(5+a  ♦ta^jX^)) 


-n'^^^W  (l,t)  for  some  Ostsn  , n^  ) • 
n o 


By  Lemna  1 and  using  equation  (3), 

Q^(n)  - Pr{F^(C*a^)-F(C>a^)  < -a^^f  (C)  (Wtx^)  ♦ o(a^) 


♦ 0(1)  . 


for  some  Ostsn, 

Choosing  n > 0 small,  (n)  -*■  0 as  in  the  proof  of  Bahadur's 

o 

Leima  2 . □ 

Proof  of  the  Theorem  Since  E (k  ) * k /n.  Lemmas  1 and  2 may 
■ n n n 

be  applied  to  show  that 

n^^^|F(Vj^)-F(e)-(k^/n-Ej^(C))|>  0 (a.s.)  . 

Further,  F(VJ-FU)  - (V^-CfU)  ♦ o(n'^^^)  (a.s.)  and 

E„(C)-F(«  - Fjj(e)-F(C)  ♦ »*n^°**n^  ^ n"'  y^{F(C*Xj(Bj^-a))-F(C)} 


3.  An  Application 

Hinkley  (1975)  suggested  a method  based  on  order  statistics 
for  estimating  the  parameter  of  a power  transformation;  his  method 
is  most  applicable  in  the  location  parameter  case.  The  Theorem 
can  be  used  to  construct  a quick  test  for  symmetry  in  more  compli- 
cated models.  Let  p * 1/2  and  define  V to  be  the  [np]^^ 


order  residual.  For  F(5p)  = Pi 


has  a limiting  normal  distribution  (with  mean  zero  and  variance 
2 


o ) independent  of  the  limit  distribution  of  Under  the 

hypothesis  of  symmetry,  " ^^1/2  ’ rejects  the 

hypothesis  if 

(5)  n^^^lv  + V ^^■P^-2V 

‘ n n n ' 

is  too  large.  To  estimate  o one  needs  estimates  of  the  density  at 
the  quantiles  Cj_p.  * which  can  be  accomplished  as  in 


Bloch  and  Gastwirth  (1968)  by  using  the  Theorem. 
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